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Abstract —Energy harvesting has been developed as an effective 
technology for communication systems in order to extend the 
lifetime of these systems. In this work, we consider a single- 
user energy harvesting wireless communication system, in which 
arrival data and harvested energy curves are modeled as con¬ 
tinuous functions. For the single-user model, our first goal is to 
find an offline algorithm, which maximizes the amount of data 
which is transmitted to the receiver node by a given deadline. 
If more than one scheme exists that transmits the maximum 
data, we choose the one with minimum utilized energy at the 
transmitter node. Next, we propose an online algorithm for this 
system. We also consider a multi-hop energy harvesting wireless 
communication system in a full-duplex mode and find the optimal 
offline algorithm to maximize the throughput. 

Index Terms —Energy harvesting, continuous arrivals. 
Throughput maximization. Optimal scheduling. Online 
optimization. 


I. Introduction 

Energy Harvesting (EH) has been appeared as an approach 
in order to make the green communications possible. In EH 
systems, nodes extract energy from the nature to extend their 
lifetimes. The harvested energy can also be used for the pur¬ 
pose of communication and specially for the transmission pro¬ 
cess. Compared to the conventional battery-powered systems, 
the EH systems have access to an unbounded source of energy 
(like vibration absorption devices, water mills, wind turbines, 
microbial fuel cells, solar cells, thermo-electric generators, 
piezoelectric cells, etc). However, the diffused nature of this 
energy makes it difficult to be used for communication. Erom 
information-theoretic point of view, the capacity of channels 
with EH nodes has been investigated. The basic results on the 
capacity of EH systems have been presented in |^, which are 
continued in other works such as i)-@- 

Another important research field in this area has focused 
on the optimal transmission scheduling considering different 
optimization problems. One of these problems looks for the 
optimum schemes to maximize the throughput in a given 
deadline I5j-|j7|. Most of the existing works have considered 
the EH nodes with discrete energy and/or data arrivals. This 
problem for a single-user fading channel with additive white 
Gaussian noise is considered in Q, where some optimal 

The material in this paper has been accepted in part in special sessions in 
the ISWCS, Brussels, Belgium, Aug. 2015. 


and suboptimal algorithms have been proposed. The authors 
in Q consider a single-user communication with battery 
imperfections while the harvested energy curve is continuous. 
Throughput is maximized in 0 while the battery is assumed to 
be limited. Moreover, two throughput maximization problems 
for single-user and multiple access channels are investigated 
in 0 with EH transmitters and receiver (Rx) while the Rx 
utilizes the harvested energy for decoding process. 

Minimizing the completion time to transmit a given amount 
of data is another problem which is considered by the re¬ 
searchers g-i[n|. In g, an algorithm is proposed to mini¬ 
mize the transmission period for a specific amount of given 
data. A broadcast channel is considered in Og, where the goal 
is to investigate the minimum of the transmission completion 
time. A single-user communication system is considered in 
|TT|, in which the Rx is not supplied by an external source 
and its energy is provided by harvesting, resulting in a limited 
energy at the Rx. One of the very interesting problems in 
the EH systems is to consider the scenarios where some 
relays participate in the transmission process. A two-hop EH 
system is considered for the discrete energy in ||T^-p?|. The 
authors in investigate the two-hop relay channel with EH 
transmitter (Tx) and relay, and one-way energy transfer from 
Tx to the relay. This problems in a half-duplex two-hop relay 
channel with EH only at the source have been considered in 


|T3|. In p4| , it has been assumed that the relay and the source 
harvest energy from the environment and the problem in both 
full-duplex and half-duplex cases is investigated. GD only 
develop the optimal offline algorithm for a half-duplex mode 
in a throughput maximization problem when both source and 
relay have only two energy packets before the given deadline. 
In fig, the authors consider a diamond channel with one-way 
energy transfer from Tx node to the relays node. Moreover, 
there are some research works on Gaussian relay channel with 
direct link with EH at both of Tx and the relay, such as El 
and fig. 

Most of the above works focuses on offline algorithms 
where the arrival process information is provided non-causally 
to the EH Tx and online algorithms are less investigated; two 
examples are E) and pO) . E) considers the design of an 
online algorithm to maximize the throughput of a wireless 
communication channel with arbitrary fading coefficients. In 
1201, the author finds a lower bound and an upper bound for the 
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completion time of optimal online algorithm to the completion 
time of optimal offline algorithm, in order to transfer a given 
data in single-user and multiple-access channels with Gaussian 
additive noise and EH nodes. In 0, 0 and 113 some 
heuristic online schemes are proposed. The stochastic nature of 


the harvesting processes are taken account in 1221-| 241 where 


optimal transmission policies for EH nodes based on Markov 
decision processes are studied. 

As mentioned above, discrete energy and/or data arrivals 
assumption is used in the most of the existing works. Since the 
harvested energy in an energy harvester is naturally continuous 
by time, a continuous-time model is more suitable for the 
amount of harvested energy p5) , | |2^ . Although, assuming a 
discrete model makes the problem more tractable, the resulted 
optimal policy for such a model is a suboptimal policy in 
general and it reduces the efficiency. One motivation for the 
continuous data arrival comes from the relaying structure. In 
general, in a throughput maximization problem at a multi¬ 
hop relay channel, the arrival data curve at the relay node 
may be continuous even when the data arrival is discrete 
at Tx. In Section V, we provide an example to show that a 
throughput maximization problem in a two-hop channel with 
continuous energy arrivals in Tx and the relay and buffered 
data in Tx reduces to a throughput maximization problem in a 
single-user channel with continuous data arrival and harvested 
energy in the relay. Moreover, using rateless codes eliminates 
the need of packetizing data in some applications p7| that 
results in the continuous model better fitting these cases. Even 
if we consider packetized communications, since in a network 
there are huge number of arrival packets with different sizes 
and arrival times which are sufficiently small and close to 
each other, the continuous model is more suitable in network 
calculus p8] . Therefore, investigating a system with contin¬ 
uous data arrival curve is crucial in analyzing EH systems. 
By considering the continuous energy and data arrivals, the 
problem enters a new space where the existing discrete-space 
proofs are not applicable. Noting this fact, the central question 
is how the existing discrete-space results change in this new 
continuous-space. We answer this question in this paper by 
providing the proofs which fit the continuous-space. Note that 
if we assume that arrival data is discrete, due to the continuous 
harvested energy, the problem enters in continuous space and 
the complexity of the proofs and the optimal algorithms do 
not change much compared with the case where both data 
and energy are continuous. We remark that, to the best of our 
knowledge, the model with discrete data arrival (not buffered) 
and continuous energy has not been considered in the previous 
works. In addition, there are very limited results for the EH 
systems with continuous energy arrivals The authors in 
| [25| investigate an EH system with a degrading battery of finite 
capacity by convex analysis tools for a continuous harvested 
energy curve. Although, in Q and p5) , the harvested energy 
curve is continuous but all data is stored in information buffer 
at the beginning of the transmission and the arrival data curve 
has not been considered. Also, |j2^ considers finite batteries, 
battery imperfections, and processing costs. 

The most challenging parts in this paper are to apply data 
and energy causalities in continuous space, which need totally 


different approaches from the discrete model in Q and the 
continuous model in p5) , in which only harvested energy is a 
continuous function and arrival data has not been considered. 
Another difference between our work and 0 is that: 0 
finds optimal policy between piecewise linear functions for 
the discrete harvested energy and arrival data curves; however, 
considering our continuous energy and data arrival curves, 
we search among the set of general functions (detailed in 
Section II). Our method for finding the algorithm considers 
both continuous and discrete arrival data functions as well 
as both continuous and discrete harvested energy functions. 
Moreover, there is a basic difference: |j9| investigates the dual 
problem i.e., a completion time minimization problem, while 
we investigate a throughput maximization problem. 

In this paper, we consider a single-user communication 
channel with an EH Tx with random data arrivals. We model 
harvested energy curve and arrival data curve with continuous 
functions in time and assume that the size of the energy 
and data buffers at Tx and Rx are infinite. We focus on 
a throughput maximization problem. However, it is possible 
that there exist more than one scheme which maximize the 
throughput. This happens when the harvested energy is more 
than the needed energy to transmit all of arrival data until the 
deadline (depends on the harvested energy curve). Hence, we 
need an extra condition for our model. We apply a constraint 
on the utilized energy to be minimum when this situation 
occurs. Eor this setup, we investigate the optimal policy which 
maximizes the amount of data transmitted to Rx by a given 
deadline. If more than one scheme exist that transmit the 
maximum data, we choose the one with minimum utilized 
energy at the Tx. 

Eirst, we consider the optimal offline policy and state its 
properties in two fold: we use new proof techniques to extend 
the discrete case properties of Q and then we prove novel 
properties for our continuous model which also hold for the 
existing discrete models. Then, based on these results, we 
propose an offline algorithm and show its optimality. We also 
consider a multi-hop channel with one Tx, one Rx and many 
relays. We propose the optimal offline algorithms in both 
throughput maximization and completion time minimization 
problems in a full-duplex mode. However, in practice, we 
may have no information about the future of the harvested 
energy and data arrival in Tx. Thus, we need an algorithm 
which without knowing the future amounts of harvested energy 
and data arrival determines the power in Tx. Eor this reason, 
we propose an online algorithm in Section VI where we do 
not have access to any information about the distribution of 
the harvesting and arrival processes. We prove that our online 
algorithm uses all of the energy or sends all of the data in the 
data buffer and the transmitted power curve is a nondecreasing 
function, similar to the optimal offline algorithm. Then, we 
derive a lower bound on the ratio of the amount of transmitted 
data in the online algorithm to the optimal offline algorithm 
and we show the cases where the ratio is good enough 
(e.g., more than 0.5 or equal to 1). Our proposed online 
algorithm reduces to the optimal online algorithm for the 
discrete harvested energy case with no data arrival, derived in 


1191. In addition, we provide two sets of examples to assess our 
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results numerically. Also, we show that discretizing harvested 
energy reduce the efficiency of system. 

The rest of the paper is organized as follow. In Section 11, 
we formulate the main problem by an optimization problem. 
In Section III, we state the properties of the optimal energy 
and data transmitted curves for the optimal offline algorithm. 
In Section IV, we first prove a theorem for a simpler special 
case of the main problem; then, we propose the offline 
algorithm which gives us the optimal transmitted data curve. In 
Section V, we investigate a multi-hop channel by a throughput 
maximization problem. In Section VI, we propose an online 
algorithm for optimization problem of Section II, and in 
Section VII, we provide the simulation results. Finally, Section 
VIII concludes the paper. 

II. System Model 

We consider a single-user wireless communication system, 
where the Tx is a node that harvests energy from an external 
source in a continuous fashion. We assume that at time t, we 
have Bs (t) bits of data (where Bg {t) is a continuous function) 
available at the Tx. The Rx is assumed to have enough energy 
to provide adequate power for decoding at any rate that can be 
achieved by the Tx. Also, we have the following assumptions. 

The harvested energy curve {Es{t)) and arrival data curve 
{Bs{t)) are bounded differentiable functions of time t, for 
t € [0,c») (except probably in finite points because of 
discontinuity in these points or not equal right and left 
derivatives) which denote the amount of energy harvested and 
the amount of data arrived at the Tx in the interval [0, t] 
respectively. Also we assume that derivative of Bgit) and 
Egif) are piecewise continuous. The transmitted energy curve 
{E{t)) and the transmitted data curve {B{t)) are continuous 
functions. We assume that E{t) and B{t) are differentiable 
functions of time, t, for t G [0, oo) (except probably in finite 
points) and these denote the amount of energy utilized and the 
amount of data that transmitted at the Tx in the interval [0, t] 
for t G [0, c»). The transmitted power curve p(t) is a piecewise 
continuous function, that denotes the amount of power used 
at the Tx for t G [0, cxd). Also, we use B*it), E*(t) and 
p* (f) as the optimal transmitted data, energy and power curves 
respectively. 

We assume that the instantaneous transmission rate relates 
to the power of transmission through a continuous function 
r(p), which satisfies the following properties: i) r(0) = 0, ii) 
r{p) is a non-negative strictly concave function in p, iii) r{p) 
is differentiable, iv) r(p) increases monotonically in p, and v) 
limp_>oo r{p) = oo. 

It can easily be seen that the above conditions are satisfied 
in many systems with practical encoding/decoding schemes, 
such as single-user additive white Gaussian noise channel with 
optimal random coding, i.e., r{p) = ^ log(l + p). 

According to the above assumptions, we have: 

B{t)= j\{^E{t'))dt', (1) 

In Sections III and IV, our goal is to find an offline algorithm, 
which maximizes the amount of data transmitted to the Rx 
in a given deadline. If more than one scheme exist which 


maximize the transmitted data, we impose another constraint: 
the algorithm must give the scheme, in which the amount of 
data is maximized, while the utilized energy is minimized at 
the Tx. Therefore, the optimization problem is: 

D{T) =max [ r{p{t))dt (2) 

p(t) Jo 

s.t. / p(t')dt' < Es(t), 0 <t <T (3) 

Jo 

r{p{t'))dt'<Bs{t), 0<t<T, (4) 

and if there exist more than one p{t) such that D{T) = Bs{T), 
then the one is selected which uses the minimum energy. 

© and Q hold due to the causality of energy and data, 
respectively. The causality of energy means that one cannot 
use the energy which is not harvested and the causality of 
data means that the data which has not arrived yet, cannot 
be sent. We remark that we investigate both continuous and 
discrete harvested energy and arrival data curves in our model. 



III. Properties of the Optimal Policy 

In this section, we state the properties of the optimal policy 
by some useful lemmas. In Subsection III-A we extend the 
discrete case properties of Q to our model which needs new 
proof techniques. In Subsection |III-B| we prove new properties 
which hold for both continuous and discrete cases. 


A. Extending the discrete case properties to our model 

Lemma III.l. If E{t) is nonlinear in t over [a, 5], the 
straight line which passes through the two points, {a,E{a)) 
and {b,E{b)), transmits more data than E{t) (utilizing same 
amount of energy). Similarly, if B{t) is nonlinear in t over 
[a, &], the straight line which passes through the two points, 
{a,B{a)) and {b,B{b)), utilizes less energy than B{t) (trans¬ 
mitting same amount of data). 

Proof. With using Jensen’s inequality in p9| and substitute 
/(.) = p(.) and ff) = r(.). Assuming that p{.) is not a 
constant function in [a, b] and a f b, because of r(.) is strictly 
concave we obtain: 

r (6 - a) > rip{t))dt. (5) 

Similarly, the result can be shown for B{t). This completes 
the proof. □ 

Lemma III.2. Let E{t) be a feasible transmitted energy curve, 
m(f) be a straight line fragment over [a, b] that passes through 
points {a,E{a)) and {b,E{b)), then E{t) is not the optimal 
transmitted energy curve if there exist a curve Enewij) ^ E{f) 
which satisfies the causality conditions and 0- Also 


EJ) 

0 <t < a 


mj) 

a <t <b . 

(6) 

EJ) 

b<t<T 



Proof. We have to show that Enewij) transmits more data 
than EJ) while it uses the same energy. First, it is clear that 
EnewJ) Ej) use equal energy to send equal amount 
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of data in (0, a) and {b^T). implies that E{t) transmits 
smaller amount of data than Enewit), using the same energy 
in (a, h). Thus, overall Enew{t) transmits more amount of data 
and E{t) is not optimal. □ 

Similarly, it can be shown that Lemma |III.2| is valid if we 
replace energy transmitted curve with data transmitted curve. 
Using the above lemma, we conclude that in the optimal 
policy, there are no two points on E*{t) such that the line 
passing through these points satisfies the causality conditions 
and is not equal to E*{t). The same results holds for 

Lemma III.3. p*{t) is not decreasing. 


Proof. We prove this lemma by contradiction. Let there exists 
an interval where p*{f) is strictly decreasing. We propose a 
transmitted energy curve (E{t)) such that transmitted data 
curve (B{t)) is equal to B*(t) at t = T, while E{t) uses 
smaller energy than E*{t). Based on contradiction assumption, 
we assume that p*{t) is strictly decreasing in [tc,tc + S], then 
E*{t) is strictly concave in this interval. (|^ implies that the 
straight line which passes through tc and tc + 5 transmits more 
amount of data than E* (f) in this interval. Now, we decrease 
the slope of this line to po such that this line transmits equal 
data with E*{t) in [tc,tc + (5]- We define E{t) a curve such 
that: (i) it is equal to E*(t) except at [tc,T] ; (ii) it is a line 
with slope of po, that proposed above, at [tc,tc + <5]; (iii) it 
is equal to E*(t) — e where e = E*{tc + <5) — E{tc + S) 
at {tc + S,T]. Since, E*{t) and E{t) transmits same amount 
of data in [tc,tc + 5], there exists to G (tc,tc + i5) such 
that p*(t) > Po for tc < t < tg, and p*(t) < po in 
to < t < tc + 6. Otherwise, p*{t) > po or p*{t) < po, 
which both of them are contradictions: because they result in 
r{p*{T))dT < Sr{po) or r{p*{T))dT > dr{po), 

but 


rt^+S 


r{p*{T))dT = 6r{po) 


(7) 


However, for every x G [a,tc + i5], we have p*{x) < po and 
since r(.) increases monotonically , we obtain 

/ r{p*{T))dT < {tc +S - a)r{po). (10) 

J a 

which is inconsistent with Q. Thus, E{T) < E*{T), but 
B{T) = B*{T). Now, if B{T) = Bs{T), then we have 
contradiction due to the assumption that p* {t) is optimal and 
proof is completed. Otherwise, if B{T) < Bs{T), we can 
increase p{f) slightly in (T — ei, T), which implies that p*{f) 
is not optimal. This completes the proof □ 


Lemma III.4. Under the optimal policy, if there exists an 
epoch that no energy and no data are received, i.e., if Bs{f) 
and Eg {t) are constant, then p* (t) is constant in this epoch. 

Proof. Similar to the above lemma, we prove this lemma 
by proposing a suitable transmitted energy curve E{f). We 
assume that p*{t) is not constant while Es{f) and Bs{f) are 
constant in [a, &]. Similar to the proof of the above lemma, 
there exists a point c such that, we can replace E*{t) in 
(a, c) with a straight line, where the new curves satisfy both 
data and energy causality conditions, E{T) < E*{T) and 
B{T) = B*{T). Hence, E*{t) is not optimal. For brevity, 
we do not include the proof details. □ 


Lemma III.5. Under the optimal policy, whenever p*{t) 
increases (at instant to), at least one of the followings holds: 
(i) E*{to) = Es{to), (ii) B*{to) = Bg{to). 

Proof. The proof is similar to the proof of Lemma |III.4| by 
proposing an appropriate transmitted energy curve E{f). □ 


Corollary 1. Based on Lemmas III.4 and III.5[ the optimal 
transmitted data/energy curve must be linear except probably 
in the epochs in which E*{f) equals Es{f) or B*{f) equals 
Bs{t). Also based on Lemma [ill. 3 , since p*{t) is an increas¬ 
ing function, E*{t) and B*{t) are convex functions. 


must hold. 

It is enough to prove that the transmitted data curve that 
obtains from E{t), i.e., B{t), satisfies the data causality 
condition. In [0,tc), since E*{t) = E{t), then B*{t) = B{f). 
Clearly, if B{f) < B*{t) in [tc,tc + <5] then B{t) < B*{t) 
in [tc + i5, T] which means that B{t) satisfies causality of 
data. Hence, we show that B{t) < B*{t) in [tc,tc + i5]. 
Since p*{x) > po and r(.) increases monotonically, we have 
r{p*{T))dT > {x — tc)r{po) for tc < x < tg. Now, we 
use contradiction to prove that B{t) < B*{t) in [to,tc + <5]. 
To do this we assume that, there exists a point a, such that 
to < a < tc + S and B{a) > B*{a). Hence, 


( 8 ) 


[ r{p*{T))dT <{a- tc)r{po). 

Jta 

which using Q we obtain: 

/ r{p*{T))dT - f r{p*{T))dT > Sr{po) - {a - tc)r{po) 




r{p*{T))dT > {tc + d - a)r{po). 


( 9 ) 


Remark 1. Though similar results to the ones in Lemmas 
III.3 IIL4 and III.5 have been proposed in Q for discrete 


energy and data arrivals for the completion time minimization 
problem, we show these results for the continuous case using 
different proof techniques from the proofs in Q, noting that 
the proofs of 0 cannot easily be extended to the continuous 
model. 


B. New general properties 

Lemma III.6. Assume that f{t) and g{t) ^ f{t) are con¬ 
tinuous piecewise differentiable functions in [o, b] such that 
g{t) < f{t) in (a, 6) and /(a) = g{a) and f{b) = g{b). If 
f{f) is convex and increasing in [a,5], then len\a,h\{f{t)) < 
^en[a,b]( 5 (f)), where len[a,b]ifit)) means the length of curve 
f{t) in interval [a, 6]. 

Proof. As illustrated in Fig. 1, we choose arbitrarily points 
fi, f 2 , tn-i in interval (a, &) and we draw the lines 
that connect any two adjacent points on f{t) and we denote 
these line segments by li, h,---. In- Then, we draw the 
perpendicular lines on li at both ends to collide g{t) and draw 
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len{li) < len{di) + len{ki). (13) 

On the other hand, since ^2 is hypotenuse in right triangle 
ABC, we obtain di < d 2 - Hence, 

len{li) < len{di) + len^k^) < len{d 2 ) + len{ki) < (14) 

len(k 2 ) + len{ki). 

Similarly we can prove, 

len{l 2 ) < len{k^). (15) 

([g and conclude, 

len{li) + len{l 2 )<len{ki) + len{k 2 ) + len{k^)=> (16) 

len[a,b] {f{t))<len[a,b] ioit))- 


Fig. 1. The doted curve f{t), the continuous cui've g{t) 



Fig. 2. The doted curve f{t), the continuous cui've g{t) 

line segments ki, k 2 ,---, kn on git) through the adjacent 
points of collisions. Also assume that curves corresponding 
to li and ki is and k^, respectively on fit) and git) in Fig. 
1. According to Fig. 1, Vi: len{li) < len{ki) < len{ki), where 
len is calculated in the defined interval. Thus, we can write, 

n n n 

^len{k) <^len{ki) < ^ lenikf) < (en[a,b](g(f)). 

i —1 i —1 i —1 

( 11 ) 


tn-i in interval (a, b), 


Since for all partitions ti, t 2 , 
inequality ([n) holds, we have: 

(en[a,b](/(f)) =sup^(en((i) < (en[a,h](p(f)), (12) 

/ 

where I is the set of all partitions in (a, b). 

Since git) ^ f{t), there exists c such that g{c) < /(c). We 
draw vertical line and tangent to f{t) in c as Fig. 2. If we 
assume that = fi{t) and dehne SiLt) as the composition of 
two curves k, and di, then from (12 1 we have. 


□ 


Lemma III.7. If in an interval we have 

B{t) < B*{t). 


7 ^ 0, then 


Proof. To prove this lemma we use contradiction. Assume 

that fg is a point such that ff.P*i^o) 0 and there exists a 

transmitted data curve B{t) that B*{tQ) < B{to) which r esults 

in B*ito) < Bsito). Since ■^p*ito) 0, from Lemma III.5 

dt _ 

we have E*{tQ) = i?s(fo) which means £'(fo) < i?*(fo)' 

Consider the transmitted power curve pi{t) as below. 


( p{t) 0<t <to 

Piit) = I 0 to<t<to + e. (17) 

{p*it) to + e <t <T 


where p{t) corresponds to the transmitted data curve B{t). 
Now we show that pi{t) is more efficient than p*{t), thus we 
hnd an e such that 0 < e < T — fg in ([T 7 | such that. 


/ r{p*{t))dt = B{to) - B*{to). 
Jto 


(18) 


If there exists an e that satishes (I8i, then piit) transmits 
Bi{T) = B*{T) data using i?i(T) < E*{T) energy and 
satishes causality conditions: this means that we have a 
contradiction, and if there does not exist any e in interval 
(0 ,T — fg], we assume that pi{f) is as follows. 


Pi{t) = 



0 <t < to 
to <t<T' 


(19) 


From above, which results in B*{T) < Bi{to) = Bi{T): this 
means we have a contradiction, too. □ 


Theorem III.8. If in the optimal policy , the data Bg{T) is 
totally transmitted, i.e., BgiT) = B*iT), then curve B*it) has 
minimum length among the feasible transmitted data curves 
that transmit all of Bs{T), that is, B*{t) minimizes the metric, 

(en[g,T](^(f)) = y ^1 + dt (20) 

among feasible curves which connects origin to {T, Bs{T)). 
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Proof. Assume that B{f) is a feasible curve such that B{T) = 
Bs{T) and B{f) ^ B*{f). Based on Lemma III.7[ whenever 
in an interval B{f) > B*{t), then B*{f) must be linear in this 
interval. We divide the interval [0,T] as follow: 

1- Intervals [ci,di\, 1 < j < n, in which we have B{t) < 
B*{t), B{ci) = B*{ci) and B{di) = B*{di), Vz. 

2- lntervals [ei, fi] , 1 < i < m, in which we have B*{t) < 
B{t) in {ei,fi), B{ei) = B*{ei) and B{fi) = B*{f), Vz. 

In the intervals of part 1 based on Lemma |I11.6| 
len[ci,di]B*(t) < len[ci,di]B{t) and if B*{t) ^ B{t) in [a, di] 
then len[c.^di\B*{t) < len[c,,di]B{t). 

In the intervals of part 2, as declared above, B*{t) in 
intervals [ci^ fi], VI < z < m is linear and it con¬ 
clude len[eiji]B*{t) < len[eiji]B{t). Hence, we have 

len[ci,di]B*(t) < len[ci,di]B{t). □ 

Conjecture 1. If in the optimal policy Eg{T) is totally used, 
i.e., Es{T) = E*{T), then, curve E*(t) has minimum length 
among the feasible transmitted energy curves that use Es{T) 
totally, that is, minimizes the metric. 


len[Q^T]{.E{t)) = 




( 21 ) 


Theorem III.9. In the optimal policy we have, 

( 22 ) 

dt [o,T] dt 

where B{t) is any arbitrary feasible transmitted data curve 
which connects the origin to {T,B*{T)). 

Proof If < ^B[t)\t~T- then proof is com¬ 

plete. Hence we assume that -^B{f)\i^x- < -^B*{t)\t^T-■ 
Since |S(f)|t=T- < and B{T) = B*{T), 

there exists an e such that for any t G {T — e,T), B*(t) < 
B{t). Also, we assume that e = min{T — t : B{t) = 


B*(t), t G [0, T)}. Thus based on Lemma IIL7 for f G [T — 
e,T], B*{t) is linear (^i7*(i)li=(T-.)+ =^i?*(i)|t=T-). 
Thus due to B*{f) < B{t) for f G [T-e.T] and B*{T-e) = 
BiT-e) then AB*{t)\t=^T-e)+ < This 

completes the proof. □ 

Remark 2. The importance of the Conjecture and Theo¬ 
rem III.8 comes from the fact that if we can prove Conjec¬ 
ture 2 we may propose the optimal offline algorithm as the 
shortest path curve among all admissible policies which use 
all the energy or send all the data in data buffer until T. As 
a result, we have a method to describe the optimal offline 
algorithm. 


Remark 3. Theorem IIII.9I describes that the maximum trans¬ 
mitted instantaneous power in the optimal policy is less 
than the maximum transmitted instantaneous power for all 
feasible policies. This becomes very significant if we impose 
an additional maximum power constraint in the optimization 
problem in ([^-Q. In this case, we first solve the problem 
without considering the maximum power constraint. If the 
optimal policy satisfies the maximum power constraint, we are 
done; otherwise, there is no feasible policy that can transmit 
the amount of data transmitted by optimal policy with no 
maximum power constraint. Also, neither all of data in data 


buffer is sent, nor all of energy until T is used for the optimal 
policy. As a result we can determine the cases where the 
maximum power constraint is a limiting element. 


IV. Optimal Offline Algorithm 

In this section, we propose the optimal offline algorithm 
for the optimization problem (|^-(0. First, for simplicity, we 
explain the main idea of this algorithm for the discrete arrival 
data and discrete harvested energy curves, i.e., we assume that 
at instants 0, tf,... Tx harvests energy in amount of Eq, Ei, ... 
and at instants 0, if,... the data arrives in amount of Bq, Bi,... 
bits. 


Definition IV.l. (Event point): every time in which the energy 
is harvested or the data is arrived is an event point. 

Theorem IV.l. Let Ui be the {i + l) — th event point. Assume 
that there exist m — 1 event points before T, and also assume 
that Urn = T, uq = 0. Then the optimal policy structure of 
the transmitted rate is as follows. 


in = argmin 

i 


min r( 

1 <Ui^Um 


EsiUi )-E{ui^_^). 


mm 

^ <.Ui ^Ujj 


Bs{u~) - B{ui^_f) 


(23) 


fBsiUiJ - E{u^^_,) 
r„ = min<; r(-), 




^in —1 J 

B{u^J = B{ui^_f) + (ui^ - zzi„_jr„, 

where Ui^ = 0, rz G iV, and is the transmitted 
interval (zzi^_j, zzi^). 


(24) 

(25) 
rate in the 


Remark 4. The above algorithm works as follows. First, we 
use ( |2^ to find the event point which imposes the data rate 
bottleneck by comparing the proper slopes. The first term 
shows the point which imposes this constraint due to the 
harvested energy shortage while the second term is related to 
the point where the arrival data causes this constraint. Then, 
we use the found even point in ( |24l i to determine the data rate 
(i.e., the slope), which also shows that the bottleneck is due 
to harvested energy or arrival data. shows the transmitted 
data update. 


Proof. We again use contradiction. First, it is concluded 
from Lemma |III.4| that the transmitted power and rate curves 
must be constant between any two event points. Thus, the 
transmitted data and energy curves are piecewise linear and 
we must hnd the optimal curves among the piecewise linear 
functions. Without loss of generality, we assume that n = 1: 


Ti = min 


{r( 


Uii ’ ZZii 


(26) 


Noting the optimal rate in interval (0,zzfc) by rj", if ri is not 
the optimal rate, based on Lemma |III.5| we must have: 
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r\ > min |r 


Es{u.)\ Bs{u,) 


}■ 


(27) 


Based on Lemma III.5 under the optimal policy, at least one 
of two following equations holds, 


r 


* 

1 


= r 


Esju^) 

Uk 


or r* 


Uk 


(28) 


We consider two cases: (i) if Uk > Ui^, then at least one of the 
causality conditions is violated due to ri < r* and ( [26l i; (ii) if 
Uk < Uij^, since the optimal policy (corresponds to r*) must 
satisfy the constraint imposed by ri at the transmitted 
rate curve, i.e., r*, must be decreased at least in an interval 
which is inconsistent with Lemma [Ill.3| Therefore, ( [26] ) gives 
r*. A similar argument proves that r 2 ,r^,..., also satisfy this 
structure. □ 


Remark 5. Our algorithm (tailored to the discrete curves) 
differs from the one in Q in two aspects: (i) In 0, the 
purpose is to hnd the best scheme among piecewise linear 
functions for the transmitted data curve. However, we hrst 
prove that the optimal transmitted data curve among all 
functions (assumptions of section II) is a piecewise linear 
function, (ii) 0 investigates a minimization completion time 
problem, however we investigate a throughput maximization 
problem. The algorithm of 0 is as follows: it hrst calculates 
the minimum needed energy and a lower bound Ti for 
completion time to transmit a given amount of data. Next, 
it uses and from 0 to Ti to hnd the next point Uk, 
where it again calculates minimum needed energy and another 
lower bound for completion time to transmit the remaining 
data. Then, this procedure is repeated from Uk to the new 
lower bound hnally to deliver all of given data. However, 
we use and ( |24| l repeatedly to compare all the event 
points (i.e., Ui ■. i = 0,1, We remark that our main 

contribution compared to 0 is considering the continuous 
model for harvested energy and arrival data curves and the 
above differences are the minor ones considering our general 
three-step algorithm tailored to the discrete curves. 


Now, we describe our proposed algorithm for the continuous 
model. First, we dehne two variables Va and ri, as follow: 


Es{u)-E{x) 

Tb = lim r(-), 

u^x+ U — X 


= lim 

It—>-3:+ 


Bs(u) - B{x) 


u — X 


(29) 


Our algorithm has three steps which depend on two curves 
Bs{t) and Eg{t). This algorithm is the extension of the 


previous algorithm that has been presented in Theorem IV. 1 


The main difference of these two algorithms is that in the al¬ 
gorithm of Theorem IV. 1 the optimal transmitted energy/data 
curve is piecewise linear; while in this algorithm, in some 
intervals, the energy/data transmitted curve could be equal 
to the harvested energy curve/arrival data curve (which are 
continuous in general). 

In this algorithm for determining the intervals in which 
transmitted data/energy curve is equal to arrival data/harvested 


energy curve, we hrst check some conditions; based on them, 
we have three states: 

State A (linear part): The transmitted data and energy curves 
are straight lines. 

State B (E*lt) = Es(t)): The transmitted energy curve is 
equal to harvested energy curve. 

State C (B*{t) = Bs(t)): The transmitted data curve is 
equal to arrival data curve. 

Our algorithm works as follows. First, the conditions in 
Tables I and II are checked (the details will be provided later 
in this section). If the conditions in Table I (or II) hold, the 
algorithm enters state B (or C). Otherwise, the algorithm enters 
state A. 

When we are in state A, the transmitted data and energy 
curves are straight lines and we can derive the interval of 
linearity. The slope of the transmitted rate is derived as: 


r = min s min r 

x<u<T 


Es(u) - E[x) 
u — X 

Bs{u) - B{x) 


x<u<T U — X 

and the end of the linearity interval is: 


(30) 


u = max argmin < mm r 
I X Ti -L 


mm 


Es{u) - E{x) 
u — X 

Bs{u) - B{x) 


x<u<T U — X 


(31) 


At the end of the interval the algorithm repeats from the 
beginning. 

Once we are in state B or C, the corresponding conditions 
(in Table I or II) must be checked continuously. The algorithm 
stays in these states as long as these conditions continue to 
hold. If one of the conditions does not hold, the algorithm 
starts from the beginning. 

If both Ta and rt are unbounded, the conditions of Tables I 
and II fail to hold and the algorithm enters state A. If both 
and rb are bounded, the conditions Bi, B2 and B3 in Table I 
and Cl, C2, C3 and C4 in table II must be checked. Otherwise, 
B4 or C5 must be checked. There are some notions used in 
Tables I and II dehned as below. 


rc{x) 

= inf i 

f Bs{u) - B{x) 

x<u<T 1 

[ u — X 

rd{x) = 

inf < r 

x<u<T y 

f Es{u) - E{x) 

\ u — X 


(32) 


(33) 


We use the notation {L > f{t),x,e} to show that there 
exists an e such that the straight line L is above the function 
f{t) in {x, x+e) and {L > f{t), x, e} to show that there exists 
no e such that the straight line L is above the function f{f) in 
{x,x + e). Also, we use the notation {L x f(t),x} to show 
that the straight line L collides with the function f{f) for t > x 
and {L x f{f),x} to show that the straight line L does not 
collide with the function f{t) for t>x opposite. 





















TABLE I 



Condition that enters algorithm into state B 

Bi 

{Li > Esit),x,€i},{L 2 > Bs{t),x,€ 2 }, 

{Ll X Es{t),x}, m = r(Efx)). 

B2 

{I/l > Ea{t),X,tl\,{L 2 > Bait),X,€2}, 

|Li X Eait),x}, m = r(E'fx)), {^2 X Ba{t),x}. 

B3 

{Ll > Ea(t),X,ei},{L 2 > Ba{t),X,€ 2 }, 

{Ll X Ea(t),x}, m = r{E'a(x)), {L2 X Ba{t),x}. 

B4 

is bounded and is unbounded and we have 

{Ll > Es{t),x,€} and {Li x Es{t),x} and m = rc{x). 


TABLE II 



Condition that enters algorithm into state C 

c, 

{L\ > Eait),x,e\}, {L2 > Ba{t),x,e 2 }, rn = 

{^2 X Ba{t),x}. 

C 2 

(Ll > Ea{t),x,ex},{L 2 > Ba(t),x,e 2 }, (Li X 

Eait),x}, m = B'aix), {L2 X Ba{t),x}. 

C3 

{Ll > Eait),X,€i}, {L2 > Bait),X,e 2 }, 

{Ll X Ea(t),x}, m = ra{x), {L2 X Ba(t),x},rc{A) f 
r{E'a{x)). 

C4 

It holds none below conditions: 

1- Bj, B 2 , or B 3 in Table 1. 

2- ({Li > Ea{t),x, ei} , {L2 > Bait), x, 62}) 

3 - ({Ll > L;s(i),3:,ei} ,{L2 > i3s(t),a:,e2}, {L2 x 

Bs{t),x}} 

4- {{Ll > Eait),x,ei}, {L2 > Bait),x,e2} ,{Li X 

Esit),x}) 

5- {{Ll > Ea{t),x,ei},{L2 > Bait),x,e2},{Li X 
Ea{t),x}, {L2 X Ba{t),x}) 

6- ({Ll > Ea{t),x,ei},{L2 > Ba{t),x,€2} ,m = rc{x). 

1- {{Ll > Ea{t),x,ei} ,{L2 > Ba{t),x,e2},m = 

rd(a:)) 

8- {{Ll > Ea{t),x,ei},{L2 > Ba{t),x,e2},{Li X 

Ea{t),x}, {L2 X Ba{t),x],rn = r^ix)) 

9- ({Ll > Ea{t),x,ei},{L2 > Ba{t),x,e 2 }, 
{Ll X Ea{t),x}, m = rc{x), {L2 X Ba{t),x}) 

C5 

Va is bounded and is unbounded and we have 

{L2 > Bs{t),x,e}, {L2 X Bs{t),x} and m = r^ix). 


In addition, assume that Li, L 2 , are two straight lines which 
are tangent to curves Eg (t) and Bg (t) in point x, respectively 
and 


m = min 






(34) 




(35) 


Remark 6. If we extend the discrete algorithm directly to our 
continuous one, the equations ( |2^ and ( |24l l must be calculated 
for every event point, which are now a continuum (every point 
in t G [0,T]) to find the next point in order to execute the 
algorithm. If this new point is same as the previous point, 
the algorithm enters state B or C. This process repeats until 
t = T. However, we propose a set of conditions (in Tables I 
and 11) to determine the state in each point. Also, we can 
show that the transmitted data curve which obtains from the 
proposed algorithm is convex. For more details assume that 
in an interval the transmitted data curve is concave. So the 
algorithm is in state B or C (The transmitted energy/data 


curve is equal to harvested energy/arrival data curve). Consider 
the beginning of this interval and use the equations ( |2^ and 
( |24| we can conclude the slope of straight line which passes 
through the endpoints of this interval is less than slope of 
transmitted energy/data curve in the beginning of this interval 
(since it must follow the harvested energy/arrival data curve). 
This results in a contradiction. 


Lemma IV.2. Let Bi{t) and i? 2 (/) be two distinct transmitted 
data curves and Bi{t) > B2{t) in the interval (a, 6) and 
Bi{t) = i? 2 (/) at i = a and / = 6. If Bi{t) is a convex 
function and Bi{t) and i? 2 (/) increase monotonically in t, 
then: 

/ ^ J (36) 


Proof. If we assume that A{t) = Bi{t) and Dminit) < 
in iso) , based on | [30l Theorem IV] it concludes that the curve 
which uses the minimum energy has shortest length. Also, 
based on Lemma III.6 Bi (/) has minimum length among the 
feasible data transmitted curves. Thus Bi{t) uses minimum 
energy and the proof is complete. □ 


Lemma IV.3. In our proposed algorithm, there do not exist 
any two points on the transmitted data curve, B{t), such that 
the line passing through these points satisfies both causality 
conditions and Bnew{t) f B{t), where Bnew{t) is the B{f) 
replaced with the straight line that passes through these two 
points in the interval made by them. 

Proof. The proof is based on contradiction. Hence, we as¬ 
sume that there exist two points s and I such Bnew{t) does 
not violate both causality conditions and Bnewif) 7 ^ B{t). 
As explained,i3(/) has at most three parts: 1- linear part, 
2- some parts in which, B{f) = Bs{f), 3- some parts 
in which E(t) = Es{t). Moreover, since the algorithm 
obtains a convex transmitted data curve, the straight line 
that passes through s and I is above of B{t) in (s, (), i.e., 
Bnew{t) > Bit) in (s,/). It is clear that s and I are not 
on the linear part. Hence, there exists a point x in (s,/) 
such that B{x) = Bs{x) or E{x) = Ea{x). We assume 
M = {t ■. B{t) = Bs{t) or E{t) = Es{t), t G (s,l)} and 
V = inf(M). If u = s there exists an e such that B(t) = Bg{f) 
or Eit) = Es{t) for s < t < s -I- e. Thus one of the 
causality conditions is violated: because, if B{f) = Bgit) in 
s < / < s -I- e, we have B{t) = Bs{f) and Bnew{t) > B{t) 
which result in Bnew{t) > Bs{t). Therefore, the data causality 
condition is violated. If E{t) = Eg{t) in s < t < s -f e, 
there exists an ei such that in s < t < s -I- ei, we have 
p{t) < Pnew{t). Thus, E{t) < Enew{t) which results in 
Egif) 'G Ejieiai^t) in s < t < s -I- Cl and the energy 
causality condition violated. Hence, we have v f s which 
results that t = v is the first instant, in which r{t) = ^B{t) 
can be changing in s < t < /. If B{v) = Bg{v), then 
the data causality condition is violated. Now assume that 
E{v) = Es{v): B{f) is linear in {s,v) and its slope is 
smaller than the slope of the straight line in curve Bnew (t) in 
s < t < 1. Therefore, p{t) < Pnew{t) in {s,v) which results 
in E{t) < Enew{t) in (s,u). Thus Es{v) < E„ew{v) and 
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the causality of energy is violated at t = u. This results in a 
contradiction which completes the proof. □ 

Lemma IV.4. If there exists a convex transmitted data curve, 
B{t) such that B{T) = Bs{T) or E{T) = Es{T) and satisfies 
the condition of Lemma IV.3 then B{t) is optimal. 


Proof. Again we use contradiction and we assume that B{f) 
is not optimal. Hence, there exists a transmitted data curve 
Bi{f) f B{t), such that (i) Bi{T) > B(T) or (ii) 
Bi\t) = B(T) and Ei(T) < E{T). First, we show that 
when B{f) < Bi{f) holds in an interval, then B{f) is linear. 
Let a = sup{f : (Vx : Bi{x) = B{x))\ 0 < x < t}. Thus, 
in [0, a), we have B{t) = Bi(t). Assume that {b,c) C (a, T] 
is the first interval that we have B{t) < Bi{t) and B{t) is 
not linear in (5, c). Thus, we can find a subinterval {b + e, d) 
where the line passing through its endpoints is under Bi{t) 
and satisfies the data causality condition. Now, let Ediff = 
min(£'i(f) — E{t)) in [b + e, d). Since E{b + e) < Ei{b + e) 
{E{b) < £'i(5) and assuming p(6) < pi{b) in (5, &+e),we can 
find a sufficiently small interval {b+ei, e) C (6+e, d) such that 
maximum energy difference between the line passing through 
the endpoints and B{t) in {b + ei,e) is less than or equal 
to Ediff. Therefore, this line does not violate the causality 
conditions which results in a contradiction. Therefore, if in an 
interval B{t) < Bi{t) holds, then B{t) must be linear. Thus, 
based on Lemma III.1[ B{t) uses less energy than Bi(t) in 
this interval. 

Now, if Bi{t) < B{t) in t e (a,T], then Bi{T) = B{T). 
Since B{t) is convex and B{f) and Bi{f) are increasing in t, 
based on Lemma IV.2 we have E(T) < Ei{T) which is a 
contradiction. 

If for t € (a,T], always Bi(t) < B(t) does not hold, then 
we define L as: 


tc = sup{f : Bi(t) = B(t) for t < Tj 


(37) 


We obtain E(tc) < Ei(tc). Because, in some intervals in 
{a,tc], B{t) is either linear and uses less energy (based on 


Lemma III.l i or Bi{t) < B(f) which again uses less energy 


(based on Lemma [IV.2| i. 

Now we have two cases, tc f T and tc = T. For the first 
case, if Bi (t) < B {t) for < t < T, we have a contradiction 
and the proof is completed, because (i) Bi{T) < B{T) or (ii) 
Bi{T) = B[T) and E{T) < Ei{T), which both are contra¬ 
dictions. If B{t) < Bi(t) for tc < t < T, then B{t) must be 
linear in this interval. For this case, if B{T) = Bs{T), then 
should Bi{T) = BgiT). Since the curve B{t) uses less energy 
than Bi{f) in tc < t < T and E(tc) < Ei(tc), we get E{T) < 
Ei(T) which is a contradiction. Having E{T) = Eg{T) im¬ 
plies that Es{T) < Ei{T) which is a contradiction, too. When 
tc = T, we have an interval {tb,T] in which Bi{t) = B{f) 
and 4 = inf {t : (Vx : Bi{x) = B{x))\ t < x < T}, then 
we can define tm as: 


tm = sup{f : Bi{f) = B{t) for t < 4} (38) 

Now, we can use the same argument with substituting of tm 
instead of tc, and the proof is complete. □ 

Theorem IV.5. The presented algorithm is optimal. 


Es(t) 





^sr(P) 


Er 


(£) 


T 



Fig. 3. The topology of the network 


Proof. The proof is directly obtained from Lemmas IV.3 and 
lIVAl □ 


V. Multi-Hoping: Throughput Maximization and 
Completion Time Minimization 

In this section, we consider a multi-hop channel with one 
Tx, one Rx and many relays and we investigate the throughput 
maximization and completion time minimization problems in 
an offline model in a full-duplex mode. For simplicity we first 
assume that we have a two-hop communication channel which 
is illustrated in Fig. 4. Then we extend the results to n relays 
in Corollaries 2 and 3. 


A. Throughput Maximization 

Following our assumption in Section II, in this model all 
harvested energy curves Es{t) and Er{t) and arrival data curve 
Bs{t) are continuous. Similar to the single-user channel in 
Section II assume that the instantaneous transmission rates in 
both relay and Tx relate to the power of transmission through 
continuous functions Vgrip) and rrd{p), respectively. Bsr{t) 
and Brd{t) are the amount of data which are transmitted 
from the Tx to the relay and from the relay to the Rx, 
respectively. Esr{t) and Ecdif) are the amount of energy that 
are utilized in the Tx and the relay to transmit data from 
the Tx to the relay, and the relay to Rx in [0, f\ respectively. 
Psr{t) and Prd{t) are the amount of power used in Tx, and 
the relay for data transmission. We assume that B*^ ^ (f) 
and E*c ^ (f) are, respectively the optimal transmitted data 
and energy curves which are obtained from problem 0 - 
0 (only when we consider the causality conditions in Tx); 
and B*^ gjt), E*^ g^^it) and p*d,B„S^) are respectively the 
optimal transmitted data curve, optimal transmitted energy 
curve and optimal transmitted power curve which are obtained 
from problem 0-0 when we substitute Bs{t) = Bsr{t) and 
Es{t) = Ej.{f) (we consider the causality conditions in Relay). 
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Now, we can formulate our problem as follows: 

= max / rrd(prd{t))dt (39) 

Psr-{t),Pr-d(t) Jo 

<E,it),0<t<T (40) 

<Er{t),0<t<T (41) 

<Bs{t),0<t<T (42) 

<[ rsr(Psr(t))dt , 0<t<r.(43) 

Jo 

( |40| l and ( |4T| l are the energy causality conditions in Tx and 
the relay. ( |42] l and ( |4?| l are the data causality conditions in Tx 
and the relay. Also we assume that and E*^{t) are the 

optimal transmitted data and energy curves in Tx, B*^{t) and 
E*d{t) are the optimal transmitted data and energy curves in 
relay for problem @-([4^. 

In the following theorem, we show that the optimal solution 
of the two-hop transmission problem in ([39]l-(|4^ is derived by 
first solving a point-to-point throughput maximization problem 
at the source, and next solving a point-to-point throughput 
maximization problem at the relay (after applying the first 
solution as the input of the second problem). 




S.t. / Psr{t ) 

Jo 

/ Prd{t ) 

Jo 

^sr {Psr {t ))dt 
‘^rd{Prd{^ 


/O 


Theorem V.l. In the optimal policy we have = 

Proof. It is enough to prove that for any feasible Bsr{t), we 
have: B*^^^ (t) < (t). To prove, we use contradic¬ 

tion as well as the technique mentioned in Remark Thus, 
assume that (a, b) is the first interval in which B*^ (t) < 

= B*d,B,M)- Therefore, 
there exists an interval (a, a -I- e) in which it) < 

P*rd,B^M)- 

Now, we use ([30ll for an arbitrary to S (a, a-fe) as follows: 


* \ • r • f B*^g {to) 

-), 


. ^ Er{x) E*^g {to) 
ml 1 

to<x<T X — to 


Prd.B-ito) = nim{ Eli r^d ( 

to<.X<l 


,BlrAx)-B*,j,,^{to) 


inf 

to <x<T 


x-to 
Er{x) - E*^ g,^ {to) 

x-to 


}■ 


(44) 


Also, we have. 


E:,^stJto) = E:,^s,Ja) + 

Erd,B^r.^A^o) = T'rd.S,,.,, (a) + 



Due to Lemma IIV.2I we have: 


(45) 


Erd,B*^^i<^) ^ E*^g^^{a) 


(46) 


Based on (l?^, (|4^ and p*^ g,^^{t) < P*d,B,A^)d G {a, to), 
we have E*^^, {to) < E*^g^^{to). This results in, 

_ Er{x) - E:^ ,,Jto) _ Er{x)-E:^ ,,,^fo) 

ml ^ < ml —-- 

to<x<T x-to to<x<T x-to 

(47) 


^Bsr(x) 


) and Xc > to 


Now, let m = argmin(- 

to<x<T ^ “ 

is a point where B*^ ^{xc) < Bsr{xc)- Then, based on 
Lemma |III.7| there exist ei > 0 and e 2 > 0 such that (i) 
in (xc — Cl, tCc + £ 2 ): B*^^^{t) is linear and B*j.^^{t) < Bsr{t), 
and (ii) B%^^{xc - ei) = Bsr{xc - ei) and B*^^^{xc + £ 2 ) = 
Bsr (a^c + £ 2 ) ■ Since in (xc — £ 1 , Xc + £ 2 ) we have s (i) < 

D td\ ^ Bsr{t) — B*j^g^^{to) 

nsr{t), men ■ ^ ^ 

Now, we have two cases: (i) '^^^^^Td.Bsr-Eo) ^ 


rEc + ^2 —*0 


.(io) 


in 

have 

B‘ , 


a^c +^2 ~^o 

^ . Because of linearity of B*^ ^{t) 

Xc — €i,Xc + £ 2 ), for the cases (i) and (ii), we 

-^ST,s (2^e~^l)~-^T-d,Bs,. Eo) ^ ^sr,BE)~^rd,Bsr Eo) 


Xc — ei—tg 




< 


•d,Bs 


t—to 

fto) 


and 


for f G \xc — 


rCc+e 2 —to t — to 

£i,Xc -f £ 2 ], respectively. Therefore, for the case (i) we have. 


Bsr{Xc £1) B*j^g^^{to) ^ i 7 *^g(Xc £1) B*^Q^^{to) 

Xc £1 fo Xc £1 to 

^ f^sr,s(f) ~ ^ Bsr{t) — B*j^ g^^{to) 

t — to t — to 

(48) 


for t G (xc — £ 1 , Xc -f £ 2 )- And, similarly, for the case (ii) we 
have, 

Bsr{Xc + £ 2 ) - B*j^g^^{to) _ Bl^^^{Xc + £ 2 ) - B*^g^^{to) 
Xc -f £2 — to a^c + £2 ~ to 

^ Bgr.sit) ~ -®rd,Bs,.(fo) ^ Bsr{t) — B*j^ g^^{to) 
t — to t — to 

(49) 


for t G (xc — £i,Xc + £ 2 )- Hence, m is not in the intervals 
that B*^ g{t) < Bsr{t). Now, the only candidates for m are the 
instants where B*^^^{t) > Bsr{t). Hence, Bsr{m) < B*^ g{m) 
and 


. r -i,Bsr{x) B*j^g {to) 

™f fed (-:-) < 

Btr,s{x) - B*d,B^ {to)^ 
inf r;^{ -^- . 

to<x<T ™ X-to 


(50) 


From (|^ and (|^, we have p^d.B^c (^ 0 ) ^ Prd,B* (^ 0 ) which 
is a contradiction. Hence, proof is complete. □ 


Corollary 2. Theorem V.l can be extended to n relays: Tx 
transmits maximum amount of data by proposed algorithm in 
Section IV, the first relay sends maximum amount of data to 
the second relay by the same algorithm and this procedure 
repeats until the Rx. 


An example: Assume that harvested energy curves in Tx 
and the relay nodes are Es{t) = e* — 1, Er{t) = 2e* — 2, 
respectively and rsr{p) = rrd{p) = | log(l + p) in which 
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logarithm is in base 2. We want to maximize the through¬ 
put from Tx to the destination. Using energy causality and 
convexity of Es{t) based on Section IV instantaneous ar¬ 
rival data at the relay is maximized in every t G [0, 1] if 
Esr(,t) = Es{t). Thus, the optimal arrival data at the relay is 
^sr,s{t) = /o 5 which is a continuous 

curve. Now, the problem reduces to a single-user throughput 
maximization problem in the relay node with harvested energy 
curve Er{t), and arrival data curve B*^ ^{t). 

B. Completion Time Minimization 

In this subsection we investigate a completion time mini¬ 
mization problem to transmit Bq amount of data to Rx in a 
multi-hop channel. We remark that the results of this section 
can be easily reduced to the single-user scenario. We can 
formulate the problem as follows; 

Toff = min T (51) 

s.t. [ rrd{Prd{t))dt = Bq, (|^ - (|^. (52) 

Jo 

Lemma V.2. in is nondecreasing. Also if 

limp_>oo = 0, then (f) is continuous. 

Proof. The proof of the first part is straightforward and is 
omitted for brevity. For the second part, for t G (t(j,to + e] 
with any e > 0 we have, 

+ (t- to)r(^), 
t — to 
(53) 

where A{t) = Es(t) — E*{to) + Aq and limt_>.tQ A(f) = 
Es{to) — E*(to) + Aq = Ai, and 0 < Ai is a finite number. 
Based on limp_>.oo = 0 and assuming p = we have, 

lim(Z?(“^)(fo) + (f-foM^)) 

t — to 

= B^’^^\to) + Ai lim ^ = B^^^^\to). (54) 

p—>^oo p 

From above, it is concluded limj_^j+ = 

can similarly prove that linij_j^j- fjitJH) (i) = 
B^^^\to). Thus is continuous. □ 

Theorem V.3. Assume that C = {t ■. = Bq} and 

limp_>oo = 0. If C 7 ^ 0 and T^m = min C, then 
'^off = Train, and optimal offline algorithm is given by the 
proposed algorithm in Section IV for given deadline Toff. If 
C = 0, there does not exist any policy to transmit the amount 
of Bo data. 


Corollary 3. We can extend Theorem V.3 to n relays with 
defining as maximum amount of data curve in Rx 

in Theorem I V.3 1 


VI. An Online Algorithm 


In this section, we want to propose an online algorithm 
for the optimization problem proposed in Section II. In our 
online algorithm, we do not have any information about the 
future of two curves Bs(t),Es(t), (even the distributions of 
two processes Bs{f),Es(t) are unknown). First, we prove that 
the proposed online algorithm uses all of the energy or sends 
all of the data in the data buffer, and the transmitted power 
curve is a nondecreasing function similar to optimal offline 
algorithm. Then, we derive a lower bound on the ratio of the 
amounts of transmitted data in the online algorithm to the 
optimal offline algorithm. 

We express the online algorithm in the following. 


Pon{t) = min 



Bremi.l') \ Brem{i') 1 
T-t + e’’ T-t + e J ’ 


(55) 


where Brem{t) = Bs{t) - Bon{t), Erem{t) = Es{f) - Eon{t) 
and e is chosen to make the Pon{t) a bounded curve. Note that 
e is a sufficiently small real number. 

According to above, in our algorithm, if in time t the amount 
of energy is the limiting element, then Pon{t) is determined 
such that all of the remaining energy in t is utilized with 
a fixed power until time T and if in time t the amount of 
information is the limiting element, then pon (t) is determined 
such that all of the remaining bits in t are transmitted with a 
fixed rate until time T. In the following, we obtain Pon{t) in 
parameters Bgif), Es{t), T. We assume that ti,t2, ...,tn are 
instants in which the Pon{t) switches from r ~^^ jq 
versa. We assume that in interval (U_i,U) we 
have Pon{t) = r-T+i ■ Hence, in {UAi+i) we have Po„(t) = 
r-T+e^ )- Thus, 


„ (++) Bon{ti) 

and after some algebraic calculation we obtain 


(56) 


Pon(t) = r~ 


f+T — t + e 


dt +?’(pon(u )) (57) 


for ti < t < ti+i. Also, we can easily show that if in f € 
(U_ 1 ,U), Pon{t) = holds, then in t G (U,f*+i) 

we have Pon{t) = 

P{tt) = (58) 

1 Li -r C 


exists a method to transmit 
. Based on Lemma |V.21 if 


Proof. Obviously, if C 7 ^ 

amount of Bo data in T, _ 

Toff < Train holds, we have B^^^\Toff) < Bo. Thus 
To// = Train- If we assume that C = 0, we can conclude 
the amount of Bo data cannot be transmitted by any time. 
Because, if there exists a time T^ such that we can transmit 
Bo amount of data until To, we get Bo < B^^^\Tc). Thus, 
Lemma V.2 concludes C □ 


ft -f-Es(t) 

Pon{t) = J ^ ^ dt + Pon{tf ) (59) 

for ti <t < fi+i. 

Lemma VI.l. Pon{t) is a nondecreasing function. 

Proof. ( |57l ) and ( |5^ conclude that Pon{t) is nondecreasing in 
all intervals {ti,ti+i) for 0 < i < n with to = 0,tn+i = T. 
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Thus, we must only prove thatp(t^ ) < p{tf) for 0 < i < n-\- instants in interval (tn^T) such that 


E (t^ 

1. If in Pon{t) = y g ™ iti,U+i) 


Bs{tj,) Bs{t^J for 1 < i < m. Thus, 


we have Pon{t) = r Therefore, ( |55| ) concludes 

= i 

Br-.rr.it-) B.^rTritf) 


that Since Bon{t~) = So„(f+) “'i 


+ T — t -f 6 dt 


7Bs{t )dt = 


f+ T — t € dt 


jBs{t )dt 


T-ti+e 

and BsitJ) < Bs{t'l), we have which 

results inpo„(f“) <Ponitt)- If in {U-i,ti) wehavepo„(t) = 
similarly we can show that pon(fr) ^ Pon{tt)’ 
which completes the proof. □ 


Lemma VI.2. In our online algorithm either limEon{T) = 


e{Bs{t+) - B,{t-)) 


T - + e 

e{B,{t+) - Bsit-J) 


+ 


f+ T — t' + e dt 


jBs(t )dt 


T — t-j, + e 


... + 


*+ T — t' + e dt' 


jBsit )dt . 
(64) 


Es{T) or limi?oji(T) = Bs{T). Moreover, if for t € {tn,T) It is clear that lim 


£->■0 


e-J-O 


eiBr.itp-Br.it-)) 


= 0, for 0 < z < m. 


we have pon{t) = r-^(.^fzp^)r then limBo„(T) = S^(T); F^om assumptions in Section II for we conclude that 


otherwise, lim ii^o„(T) = Es(T). 


e-fO 


£->■0 


^^Bs{t) is bounded in intervals {tj^,tj.j^^) for 0 < i < m 
with tjg = tn and Thus, 


Proof. We assume that for t G {tn,T) we have Pon{t) = 

the other condition can be proved similarly. 0 < 


Bon{T) = / r{pon{t))dt = / r{pon{t))dt 


3 i + l 


++ T — t c dt 


jBsit )dt < 


H + l 


t+ T — t + e 


Mdt 


(65) 


for 0 < i < TO, where ^Bs{t)\t=t+< M and ^Bs{t)\t=t-< 
p p M for 0 <t <T mwhich f^Bs{f)\t=t-, f^Bslf)\t ^ 1 + mean 

+ J r(j>onit))dt = Bon{tn) + J r{Pon(t))dt. (60) jgfj ^nd right derivatives of Bgit) in t. 


From ( [57l l: 

riPonit))= 


Also it can be easily shown that, lim j, = 


0 for 0 < i < TO. Hence the proof is complete. 


□ 


t+ T — f + e 
for tn <t <T. So, 




T — tn + e 


Bon{T) = 


rT nt dT3 (f) 

^ * -dtdt 


„ Jtt T — t + e 

+ - tn) + Bnnitn) = 


Theorem VI.3. Assume I and k are two real numbers such 
that ti < J < ti+i and Es(j) = If Ponij) = 

then 4(1 - }) < otherwise < 

BorrlT) 

BoffiT)- 

Proof. Note that if Pon{j) = Tfprp]-, then 


T — tn + (■ 

r {T-t)^BPt) ^^. fp-tn) 

t± T — t + e 


T — tn + € 


T — tn + e 


Bon ifn) ■ 


BsitpP 

(62) 


^<P iE 

1 + e I 

because if ( [66] ) does not hold then should 

E,{^)-Eon{^) E^iP) 

T-T +e r + e ■ 


( 66 ) 


(67) 


Also, due to the fact that Pon{t) is a nondecreasing function 


Now, it is enough to prove that lim(i?s(r) — Bon(T)) = 0. (based on Lemma I VI. lb, we have, 

£—>■0 '- ' 


Bs{T) - Bon{T) = B,{T) - B,{t+) + S,(f+) - = 


K„(T) ^ E,{B)_Eon{^) 


T — 
I 


T-f+e 


( 68 ) 


^ (^+) After some algebraic calculation, it can be shown that ( |67| ) 

T — tn + € and (|68ll result in a contradiction and so (|66ll holds. Also, we 


T — tn + e 
e 


Bon{tn) — 


T — tn + e 


Bs{t+) - 


+ T — f + € dt 
e 


TBs{t )dt 


have. 


T — tn + r 


Bon (fn) ■ 


(63) 


Bon{T) = Bonij) + r{pon{t))dt > 

r{pon{t))dt >{T- j)r{pon{j))- (69) 


It is clear that lim —r— : — Bs{tf) — 0 and Also, we have from Lemma 1111.11 

£->■0 1 — tn + e ' -' 

lim rpf , Bon{tn) = 0, because, Bs{t) is bounded 


£->0 


and as a result Bon{t) is bounded, too. Now, assume that 


Boff(T) < Tr{^^). 


(70) 
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Thus, it is concluded from 
that e is small sufficiently, 


and ([Toll and assuming 


■ ~Mn\ 


Bon{T) 






(71) 


r{~ 

Now, since Pon{t) is a nondecreasing function in t, if 

Ponij) = r~^ Jjjgjj Jj^yg^ 

Bon{T) > BUj) + 


rp _ J_ rp 

T-^ +e ^ r T-^ 


B. 


T 

on(y)> 


T-{ 

T-^+e 


T 

Bsij). 


Bon{T) ^ B,{^) 


B,ff{T) - B,{Ty 

and the proof of the theorem is complete. 


(73) 

□ 


Corollary 4. The following results are concluded from The¬ 
orem IV1.3I 

1 , 


(i) If in (f„,T), Pon{t) = r then 




Bor^jT) 


T-t+c" o^fni) 

which means that the online algorithm transmits all of data 
bits of those in offline algorithm. 

(ii) If = Eg(T) and Pon(f) = r~^(), then 

B iT'] 3 

^ (j.) > -, which means that the online algorithm transmits 

at least half of data bits of those in offline algorithm. 


Proof. For (i), in Theorem VI.3 I can be chosen sufficiently 
close to 1. (ii) can be derived by substitution. □ 


bits in Fig. (c) and Fig. (d). We remark that due to the 
nature of the harvested energy and arrival data, these functions 
must be non-decreasing. These figures show the harvested 
energy/arrival data curves and the transmitted energy/data 
curves based on our proposed offline and online algorithms 
versus the time. In Fig. ffl (a) and Fig. ffl (b), we assume that 
T = 0.6 s while in Fig. ffl(c) and Fig. ffl(d), we assume that 
r = 2 s. 


As can be easily seen from Fig. (a) and Fig. (b), the 
Eoff{t) curve consists of three parts: the offline algorithm 
is in state C in (0,77) (approximately (0, .34)), it is in state 
A in {D,E) (approximately (.34,0.54)), and it is in state B 
in {E,T) (approximately (0.54,0.6)). In (0,77), Eoff{t) is 
nonlinear; Eoff{t) f Es{t) and this means that B{t) = Bs{t), 
according to Lemma III.5, in {E,T), Eoff{t) is nonlinear; 


Boff{t) f Bs(t) and this means that E[f) = Es(t), according 
Moreover, we observe that p{t) is anonde- 


to Lemma III.5 


(72) creasing function because ^Eoff{t) > 0 (Lemma 


IIL31. We 


Also we know Boff{T) < Bs{T) and since e is sufficiently 
small we obtain. 


remark that the optimal algorithm can transmit at most 2.9 
bits at the end of the interval (T = 0.6) while it uses all the 
harvested energy, i.e., 77o//(0.6) = 77s(0.6). Thus, the system 
is ’’energy constrained” in this case. 

As can be easily seen from Fig. (c) and Fig. (d), the 
Eoff{t) curve consists of four parts: the offline algorithm 
is in state A in (0,A) (approximately (0, .1.5)), it is in 
state C in (A, 77) (approximately (1.5,1.63)), it is in state 
A in (77,(7) (approximately (1.63,1.86)) and it is in state 
B in {C,T) (approximately (1.86,2)). In (A, 77), Eoff{t) is 
nonlinear; Eg f fit) f 77s (f) and this means that 77(f) = 77s (f), 
according to Lemma III.5 in {C,T), E^ffit) is nonlinear; 
Bo f fit) f 77s (f) and this means that 77(f) = 77s (f), according 
to Lemma IIL5 Moreover, we observe that p(f) is anonde- 
creasing function because -^Eoffit) > 0 (Lemma IIL3l. We 


remark that the optimal algorithm can transmit at most 6 bits 
at the end of the interval (T = 2) while it uses all the harvested 
energy, i.e., 77oy/(0.6) = 77s(0.6). Thus, the system is ’’energy 
constrained” in this case. 


Although, there are many examples that this bound is good 
for them but the authors believe that the above lower bound is 
not tight enough for all the arbitrary two curves 77s(f), Bgit), 
and the algorithm is more efficient than the bound in these 
examples. Another advantage of this online algorithm is that 
it does not require any information about the distributions of 
the two processes 77s (f) and 77s (f). 

VII. Numerical Results 

In this section, we provide numerical examples to explain 
our results. Consider a band-limited additive white Gaussian 
noise channel with bandwidth W — 1 Hz. Also, the actual 
channel gain divided by the noise power spectral density mul¬ 
tiplied by the bandwidth is 1. So we have, r(p) = log(l +p), 
where the logarithm is in base 2. We consider two different 
77s (f), 77s (f) curve pairs. The first parr consists of two convex 
functions 77s (f) = lOOf^ J and 77s(f) = lOf^ bits in Fig. 0 (a) 
and Fig. (b), while the second pair consists of more general 
functions 77s(f) = 8(f—1)^-|-8 J and 77s(f) = 3.5(f—l)^-1-3.5 


For the online algorithm we assume that e = .001. It can be 
easily seen that 77o„(f) and 77o„(f) are convex hence, Ponit) is 
nondecreasing (Lemma |VI.l i. Also, in Fig.|^(a) gon( 0.6) » 
77s(0.6) and in Fig. (c) Eoni"^) ~ 77s(2) (Lemma VI.2i. 
From Fig. 4 (b) we have 


^on\ , 


approximately 69 percent of data that transmitted by offline 
algorithm is transmitted by online algorithm and from Fig. |4| 

B fTl 4 8 ^ 

(d) we have ^ "O. (t) ~ ^ which means that approximately 
80 percent of data that transmitted by offline algorithm is 
transmitted by online algorithm (using all harvested energy 
in both algorithms). 




(T) 


which means that 


As mentioned in Section I, Fig. shows the necessity of in¬ 
vestigating continuous model instead of discretizing harvested 
energy and arrival data curves to achieve the optimal perfor¬ 
mance. In Fig. 1^ the Edsit) and Bdsit) are the discretized 
version of the Eg it) and Bg (f) in Fig. 0 (a) and Fig. 0 (b), 
respectively. It can be easily seen that the optimal offline 
algorithm with discretizing transmits 2.25 bits (compared to 
2.9 bits in continuous model) which reduces the efficiency. 
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time(s) time(s) 

(a) (b) 




(c) (d) 


Fig. 4. Online and Optimal offline algorithms without discretizing 




(a) 


(b) 


Fig. 5. Online and Optimal offline algorithms with discretizing 


VIII. Discussion and Conclusion 

In this paper, we considered an EH system with continuous 
arrival data and continuous harvested energy curves; while, 
most of the research in this area considered a discrete model 
due to the mathematical tractability of the ensuing system 
optimization. Our work can be compared to the ones in ||^, 
Hg, |2g. In p5) , a model with continuous harvested energy 
curve is investigated, while it is assumed that the large amount 
of data exists to transmit (no arrival data process). Compared 
to our model, in p5] the causality condition of 0 does not 
exist. Thus, the model in this paper is more general than 


1251. In addition. 


focuses on battery imperfection and 


processing gain which makes the results completely different 
from our results. In 0, only the model with discrete Es(t) and 
Bs (f) curves is investigated and its goal is to hnd the optimal 
policy that minimizes the completion time for transmitting a 
given amount of data among piecewise linear curves; while, 
in this paper we consider a model that includes both discrete 
and continuous models for Es{t) and Bs{t), and hnd optimal 
policy among all of curves assumed in Section II, therefore, 
the considered model of this paper is more general than 0. 
We compared our results thoroughly in Sections III and IV. In 
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Hg, the optimal online algorithm for the discrete case with no 
data arrival is proposed which derives the transmitted power 
based on the available energy in the buffer (the sole constraint 
in this case). Our proposed online algorithm easily reduces to 
the mentioned algorithm by making the data available at the 
beginning and discretizing the harvested energy curve. 
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